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Abstract 

We give an 0(y / nlog n)-query quantum algorithm for evaluating size-n AND-OR formulas. 
Its running time is poly-logarithmically greater after efficient preprocessing. Unlike previous 
approaches, the algorithm is based on a quantum walk on a graph that is not a tree. Instead, 
the algorithm is based on a hybrid of direct-sum span program composition, which generates 
tree-like graphs, and a novel tensor-product span program composition method, which generates 
graphs with vertices corresponding to minimal zero-certihcates. 

For comparison, by the general adversary bound, the quantum query complexity for evaluat- 
ing a size-n read-once AND-OR formula is at least fl(y/n), and at most 0(y/n log nj log log n). 
However, this algorithm is not necessarily time efficient; the number of elementary quantum 
gates applied between input queries could be much larger. Ambainis et al. have given a quan- 
tum algorithm that uses y/n2°^ logn ^ queries, with a poly-logarithmically greater running time. 

1 Introduction 

An AND-OR formula is a rooted tree in which the internal nodes correspond to AND or OR gates. 
The size of the formula is the number of leaves. To a formula (p of size n and a numbering of the 
leaves from 1 to n corresponds a function ip : {0, l} n — > {0, 1}. This function is defined on input 
x S {0, 1}™ by placing bit Xj on the jth leaf, for j = 1,2, ... ,n, and evaluating the gates toward 
the root. Evaluating an AND-OR formula solves the decision version of a MIN-MAX tree, also 
known as a two-player game tree. 

Let Q((p) be the quantum query complexity for evaluating the size-n AND-OR formula (p. 
Quantum query complexity is the generalization of classical decision tree complexity to quantum 
algorithms. Now the general adversary bound of ip is Adv ± (v9) = y/E [BS04, HLS07], and thus 
Q((p) = r2(Adv ± (<^)) = £l(y/n). Since the general adversary bound is nearly tight for any boolean 
function, in particular Q((p) = ©(y^ log n/ log log n) [Rei09a]. (Interpreted in a different way, this 
says that the square of the quantum query complexity of evaluating a boolean function is almost 
a lower bound on the read-once formula size for that function [LLS06].) However, the algorithm 
from [Rei09a] is not necessarily even time efficient. That is, even though the number of queries 
to the input is nearly optimal, the number of elementary quantum gates applied between input 
queries could be much larger. 

Ambainis et al. [ACR + 07] have given a quantum algorithm that evaluates <p using y / n2°^ logn ) 
queries, with a running time only poly-logarithmically larger after efficient preprocessing. We reduce 
the query overhead from 2°( v/logn ) to only O(logn), with the same preprocessing assumption. 
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Theorem 1.1. Let <p be an AND-OR formula of size n. Then <p can be evaluated with error at most 
1/3 by a quantum algorithm that uses 0(y/nlogn) input queries. After polynomial-time classical 
preprocessing independent of the input, and assuming unit-time coherent access to the preprocessed 
string, the running time of the algorithm is y/n (logn) ^ 1 ). 

An improvement from 2°(^ logn ) to 0(log n) overhead may not be significant for eventual practi- 
cal applications. Additionally, the algorithm does not obviously bring us closer to knowing whether 
the general adversary bound is tight for quantum query complexity, because its overhead is larger 
than the 0(logn/loglogn) overhead of the query algorithm from [Rci09a]. (It may be that the 
analysis used to prove Theorem 1.1 is somewhat loose.) 

However, the idea behind the algorithm is still of interest, as it provides a new solution to the 
problem of evaluating AND-OR formulas with large depth. If cp is a formula on n variables, with 
depth d, then the [ACR + 07] algorithm, applied directly, evaluates cp using 0(y/nd) queries. 1 Thus 
for a highly unbalanced formula, with depth d = the quantum algorithm performs no better 

asymptotically than the trivial n-query classical algorithm. Fortunately, Bshouty et al. have given 
a "rebalancing" procedure that takes AND-OR formula cp as input and outputs an equivalent AND- 
OR formula cp' with depth d! = 2°(v / I^) and size ri = n 2°(v /I ^) [BCE91, BB94]. Appealing to 
this result, [ACR + 07] evaluates cp' using queries. 

The algorithm behind Theorem 1.1 gets around the large-depth problem without using formula 
rebalancing. Instead, the algorithm is based on a novel method for constructing bipartite graphs 
with certain useful spectral properties. Ambainis et al. run a quantum walk on a graph that matches 
the formula tree, except with certain edge weights and boundary conditions at the leaves. This tree 
comes from glueing together elementary graphs for each gate. We term this composition method 
"direct-sum" composition, because the graph's adjacency matrix acts on a space that is the direct 
sum of spaces for each individual gate. Direct-sum composition incurs severe overhead on highly 
unbalanced formulas, making the query complexity at least proportional to the formula depth. 

The new algorithm begins with the same elementary graphs, with even the same edge weights. 
However, it composes them using a kind of "tensor-product" graph composition method. Overall, 
this results in graphs that have much lower depth, although they are not trees. By carefully 
combining this method with direct-sum composition, we obtain a graph on which the algorithm 
runs a quantum walk. The two approaches are summarized in more detail in Section 1.1 below. 

The general formula-evaluation problem is an ideal example of a recursively defined problem. 
The evaluation of a formula is the evaluation of a function, the inputs of which are themselves inde- 
pendent formulas. As argued in a companion paper [Rei09b], quantum computers are particularly 
well suited for evaluating formulas. Unlike the situation for classical algorithms, for a large class 
of formulas the optimal quantum algorithm can work following the formula's recursive structure. 
Since Theorem 1.1 does not require AND-OR formula rebalancing, it extends this quantum recur- 
sion paradigm. Besides its conceptual appeal, this may also be important because the effect of 
rebalancing on the general quantum adversary bound appears to be less tractable for formulas over 
gate sets beyond AND and OR. Therefore the rebalancing step that aids [ACR + 07] might not be 
useful to solve the large-depth problem on more general formulas. The hybrid graph composition 
method is another tool that might generalize more easily. 

Actually, [ACR+07, Sec. 7] only shows a bound of 0{y/nd 3/2 ) queries, but this can be improved to 0(y/nd) using 
the bounds on <J±(cp) below [ACR + 07, Def. 1]. The improved analysis of the same algorithm in [Rei09b] tightens this 
to 0{\fnd), which is also the depth-dependence found by [Amb07]. 
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Table 1: Comparison of some classical and quantum query complexity results for formula evaluation. 
Here the exponent a is given by a = log 2 ( 1+ 4^ ) ~ 0.753, and S is any fixed, finite gate set. Under 
certain assumptions, the algorithms' running times are only poly-logarithmically slower. 

Our algorithm is developed and analyzed using the framework relating span programs and 
quantum algorithms from [Rei09a]. The connection to time-efficient quantum algorithms, especially 
for evaluating unbalanced formulas over arbitrary fixed, finite gate sets, has been developed further 
in [Rei09b]. Table 1 summarizes some results for the formula-evaluation problem in the classical 
and quantum models; for a more detailed and inclusive review, see [Rei09b]. Section 1.2 below will 
go over only the history of quantum algorithms for evaluating AND-OR formulas. 

1.1 Idea of the algorithm 

As an example to illustrate the main idea of our algorithm, consider the AND-OR formula (f(x) = 
{[(xi A x 2 ) V S3] A S4) V (S5 A [xq V S7]), where A and V denote AND and OR, respectively. In 
Figure 1(a), this formula is represented as a tree. 

The [ACR + 07] algorithm starts with the graph in Figure 1(b), essentially the same as the 
formula tree, except with extra edges attached to the root and some leaves. The edges should be 
weighted, but for this intuitive discussion take every edge's weight to be one. 

Consider an input x £ {0, l} 7 . Modify the graph by attached a dangling edge to vertex j if 
Xj = 0, for j = 1,2, ... ,7. Then it is simple to see that the resulting graph has an eigenvalue-zero 
eigenvector supported on vertex (or rather its adjacency matrix does) if and only if <p(x) = 1. If 
we added an edge off vertex 0, then the resulting graph would have an eigenvalue-zero eigenvector 
supported on the new root if and only if ip(x) = 0. 

The [ACR + 07] algorithm takes advantage of this property by running (phase estimation on) a 
quantum walk that starts at the root vertex. The algorithm detects the eigenvalue-zero eigenvector 
in order to evaluate the formula. 

This algorithm does not work well on formulas with large depth. For example, consider the 
maximally unbalanced formula on n inputs, a skew tree. The corresponding graph is nearly the 
length-n line graph. It will still have an eigenvalue-zero eigenvector supported on the root if and 
only if the formula evaluates to zero. However, the algorithm will require Q,(n) time to detect this 
eigenvector, because its squared support on the root is only 0(l/n) after normalization, and because 
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the spectral gap around zero will also be 0(l/n). (The spectral gap determines the precision of 
the phase estimation procedure, and hence its running time. It corresponds to the squared support 
of eigenvalue-zero eigenvectors by [Rei09a, Theorem 8.7].) Alternatively, one can argue that the 
algorithm requires f2(n) time because it takes that long even to reach the deepest leaf vertices. 

Now consider the graph in Figure 2(a). Again modify the graph according to an input x £ {0, l} 7 
by attaching dangling edges to those vertices with Xj = 0. Considering a few examples should 
convince the reader that the resulting graph has an eigenvalue-zero eigenvector supported on vertex 
if and only if cp(x) = 0. Note, though, that the distance from "output" vertex to any of the 
"input" vertices 1 to 7 is at most two. The graph is also far from being a tree. Its main feature is 
that the "constraint" vertices — the vertices aside from 0, 1, ... , 7 — are in one-to-one correspondence 
with minimal zero-certificates to <p. For example, for x = 0101011, tp{x) = 0, but flipping any bit 
of x from to 1 changes the formula evaluation from to 1. The corresponding constraint vertex 
is connected to exactly those input vertices j for which Xj = 0. 

The graphs in Figures 1(b) and 2(a) represent two extremes of a family of graphs that evaluate 
cp in the same manner. The graph in Figure 1(b) can be seen (essentially) as coming from plugging 
together along cp the individual graphs in Figures 3(a) and 3(b) that evaluate single OR and AND 
gates in the same manner. We term this "direct-sum" composition. The graph in Figure 2(a) comes 
from a certain "tensor-product" composition of the graphs from Figures 3(a) and 3(b). (Figure 3 
shows several other examples of tensor-product graph composition.) 

With the correct choice of edge weights, tensor-product composition leads to graphs for which 
the squared support of the unit-normalized eigenvalue-zero eigenvector on the root is £l{l/y/n) 
for a formula of size n. This implies by [Rei09a, Theorem 9.1] a quantum algorithm that uses 
(^(-y/nlogn/loglogn) queries to evaluate the formula. There is no issue with deep formulas. How- 
ever, the algorithm will not be time efficient. Essentially, the problem is that the number of vertices 
can be exponentially large in n, as can be their degrees, which makes it difficult to implement a 
quantum walk efficiently. 

Theorem 1.1 gets around this problem by using a combination of the two methods of composing 
graphs. For example, the graph in Figure 2(b) also evaluates the formula cp in the same manner. 
One can think of the vertex c as evaluating the subformula 25 A (x& V X7). The subgraph it cuts off 
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Figure 2: For the formula from Figure 1(a), we display the reduced tensor-product composed 
span program in (a), and the hybrid-composed span program in (b) for the case when the edge 
to the subformula on inputs xc ) ,x§,x^ is checkpointed (see Section 3.3). In each case, the output 
vertex corresponding to the target vector is labeled and the input bits are labeled from 1 to 
7. The other vertices in (a) are labeled according to the corresponding maximal false inputs (see 
Definition 3.5 and Lemma 3.6). In (b), the checkpoint vertex is labeled c — this vertex corresponds to 
the free input vector added in direct-sum composition (see Definition 2.4) — and the other vertices 
have been labeled according to maximal false inputs with the checkpointed subformula grouped 
together. In (c), the edge weights for the graph in (b) are specified using the biadjacency matrix. 
The parameters a, 5, . . . are marked with ' or " to indicate to which gate in the formula of Figure 1(a) 
they correspond. 
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has been composed in a direct-sum manner with a tensor-product-composed graph for the formula 
([(xi A x%) V X3] A X4) V x c . By combining the two composition methods, we can manage the 
tradeoffs, controlling the maximum degree and norm of the graph, while also avoiding the formula 
depth problem. 

Although our algorithm can be presented and analyzed entirely in terms of graphs, we will 
present it in terms of span programs. Span programs are part of a framework for designing and 
analyzing quantum algorithms [Rei09a], for which Section 2 gives some necessary background. 
Eigenvalue-zero eigenvectors correspond to span program witnesses and the squared support on 
the root corresponds to a complexity measure known as the full witness size [Rei09b]. The two 
graph composition techniques described above correspond to different ways of composing general 
span programs. 

1.2 Review of quantum algorithms for evaluating AND-OR formulas 

Research on the formula-evaluation problem in the quantum model began with the simple ra-bit 
OR function, OR n . Grover gave a quantum algorithm for evaluating OR ra with bounded one-sided 
error using 0(y/n) oracle queries and 0(\/n log log n) time [Gro96, Gro02]. 

Grover's algorithm, together with repetition for reducing errors, can be applied recursively 
to speed up the evaluation of more general AND-OR formulas. For example, the size-n AND- 
OR formula AND v ^o(OR y ^, . . . , OR^) can be evaluated in 0(y/n log n) queries. Here the extra 
logarithmic factor comes from using repetition to reduce the error probability of the inner OR^ 
evaluation procedure from a constant to be polynomially small. Call a formula layered if the gates 
at the same depth are the same. Buhrman, Cleve and Wigderson show that the above argument 
can be applied to evaluate a layered, depth-d AND-OR formula on n inputs using 0(y/n\og d ~ l n) 
queries [BCW98, Theorem 1.15]. 

H0yer, Mosca and de Wolf [HMW03] consider the case of a unitary input oracle O x that maps 

Ox ■ \<p) 8> \j) ® \b) ® |0> ^ \<p) \j) ® (\bexj) ® \^ x , j<Xj ) + \b®xj) ® iVta,)) , (1-1) 

where \ip x j tXj ), \f^x,j,xj) are pure states with [| IV'ssj,^)]! 2 — 2/3. Such an oracle can be implemented 
when the function j 1— * Xj is computed by a bounded-error, randomized subroutine [NCOO]. H0yer 
et al. allow access to O x and O^ 1 , both at unit cost, and show that OR n can still be evaluated using 
0(y/n) queries. This robustness result implies that the logn steps of repetition used by [BCW98] 
are not necessary, and a depth-d layered AND-OR formula can be computed in 0{^fnc d ~ l ) queries, 
for some constant c > 1000. This gives an 0(y / n)-query quantum algorithm for the case that the 
depth d is constant, but is not sufficient to cover, e.g., the complete, binary AND-OR formula, for 
which d = log 2 n. 

A breakthrough for the formula-evaluation problem came in 2007, when Farhi, Goldstone 
and Gutmann presented a quantum algorithm for evaluating complete, binary AND-OR formu- 
las [FGG07]. Their algorithm is not based on iterating Grover's algorithm in any way, but instead 
runs a quantum walk — analogous to a classical random walk — on a graph derived from the AND- 
OR formula graph as in Figure 1. The algorithm runs in time 0(y/n) in a certain continuous-time 
query model. 

Ambainis et al. discretized the [FGG07] algorithm by reinterpreting a correspondence between 
discrete-time random and quantum walks due to Szegedy [Sze04] as a correspondence between 
continuous-time and discrete-time quantum walks [ACR + 07]. Applying this correspondence to 
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quantum walks on certain weighted graphs, they gave an 0(y / n)-query quantum algorithm for 
evaluating "approximately balanced" formulas, extended in [Rei09b]. Using the formula rebalancing 
procedure of [BCE91, BB94], the [ACR+07] algorithm uses v /^2°(v' I °s") queries in general. This 
is nearly optimal, since the adversary bound gives an Q(-^/n) lower bound [BS04]. 

This author has given an 0(y / nlogn/loglogn)-query quantum algorithm for evaluating arbi- 
trary size-n AND-OR formulas [Rei09a]. In fact, the result is more general, stating that the general 
adversary bound is nearly tight for every boolean function. However, unlike the earlier AND-OR 
formula-evaluation algorithms, the algorithm is not necessarily time efficient. 



2 Span programs 

In this section, we will briefly recall some of the definitions and results on span programs from [Rei09a, 
Rei09b]. This section is essentially an abbreviated version of [Rei09b, Sec. 2]. 

For a natural number n, let [n] = {1, 2, . . . , n}. For a finite set X, let C x be the inner product 
space C'^' with orthonormal basis {\x) :i£ X}. For vector spaces V and W over C, let £(V, W) 
be the set of linear transformations from V into W, and let C(V) = C(V, V). For A G C(V, W), 
\\A\\ is its operator norm. Let B = {0, 1}. For a string x G B n , let x denote its bitwise complement. 



2.1 Span program full witness size 

The full witness size is a span program complexity measure that is important for developing quan- 
tum algorithms that are time efficient as well as query efficient. 

Definition 2.1 (Span program [KW93]). A span program P consists of a natural number n, a 
finite- dimensional inner product space V over C, a "target" vector \t) G V , disjoint sets If ree and 
Ij,b for j G [n], b G B, and "input vectors" \vi) eV for i G If rcc U \Jje[n],beB J j,b- 
To P corresponds a function fp : B n — > B, defined on x G B n by 

f p ( x \ = / 1 */ I*) G Span({|vj) : % G I free U \J je[n] I jtXj }) 
1 otherwise 

Some additional notation is convenient. Fix a span program P. Let / = If ree U (Jjefnl fees ^if>- 
Let A G L{C\V) be given by A = Eie/I^l- For x € sn > let J ( a; ) = J free U \J je[n] /,>. and 
n (^) = T,iei( x ) l*X*l G ^( C/ )- Then fp( x ) = 1 if I*) G Range(^n(x)). A vector |to) G C 1 is said 
to be a witness for fp(x) = 1 if n(x)|u>) = \w) and A\w) = \t). A vector \w') G V is said to be a 
witness for f P (x) = if \t\w') = 1 and Ii{x) A^\w') = 0. 

Definition 2.2 (Witness size). Consider a span program P, and a vector s G [0, oo) n of nonnegative 
"costs." Let S = Y^jeM beBiei b V^JNX*I ^ ^-(C 7 )- For each input x G B n , define the witness size 
of P on x with costs s, wsize s (P, x), as follows: 

(mm lw) , AU{x)lw)=lt) \\S\w)\\ 2 if f P {x) = 1 
wsize s (P,x) = <^ minK):(tK)=1 ||^t| w ')|| 2 iff P (x) = (2-2) 

The witness size of P with costs s is 

wsize s (P) = max wsize s (P, x) . (2-3) 

x£B n 
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Define the full witness size fwsize s (P) by letting S* = S + Yliei f IO(*l an< ^ 

{^^\ w ):An(x)\w)=\t)(^ + \\S f \w)\\ 2 ) if f P {x) = 1 

min K>: {tW)=1 || 2 + ||SA V) || 2 ) if f P {x) = ( 2 - 4 ) 

n(x)At|«/}=0 

fwsize s (P) = max fwsize s (P, x) . (2-5) 

x€B n 

When the subscript s is omitted, the costs are taken to be uniform, s = 1 = (1,1,... ,1), e.g., 
fwsize(P) = fwsizer(P). The witness size is defined in [RS08]. The full witness size is defined 
in [Rei09a, Sec. 8], but is not named there. A strict span program has if ree = 0, so S* = S, and a 
monotone span program has Ijo = for all j [Rei09a, Def. 4.9]. 

Theorem 2.3 ([Rei09a, Theorem 9.3], [Rei09b, Theorem 2.3]). Let P be a span program. Then 
fp can be evaluated using 

T = 0(fwsize(P) || abs(A Gp )||) (2.6) 

quantum queries, with error probability at most 1/3. Moreover, if the maximum degree of a vertex 
in Gp is d, then the time complexity of the algorithm for evaluating fp is at most a factor of 
(logd)(log(Tlogd))°^ 1 ' ) worse, after classical preprocessing and assuming constant-time coherent 
access to the preprocessed string. 

2.2 Direct-sum span program composition 

Let / : B n — > B be a boolean function. Let SC [n]. For j £ [n], let nij be a natural number, with 
rrij = 1 for j S. For j G S, let fj : B m i -► B. Define y : B mi x • • • x B m " -> B n by 

y(x) j ={ fj{xj) ifjeS (2.7) 

Define g : B mi x ••• x B mn — > B by g(x) = f{y{x)). Given span programs for the individual 
functions / and fj for j £ S, we will construct a span program for g. 

Let P be a span program computing fp = f. Let P have inner product space V, target vector 
\t) and input vectors \vi) indexed by If ree and Ij c for j £ [n] and c £ B. 

For j G [n], let Sj € [0, oo) m -? be a vector of costs, and let s G [0, 00)^"^ be the concatenation 
of the vectors Sj. For j G S, let P j0 and P J be span programs computing fpji = fj : B m i —* P 
and /pjo = -i/j, with = wsize Sj . (P j0 ) = wsize Sj (P 3 )• For c £ B, let P JC have inner product 
space Vi c with target vector \P C ) and input vectors indexed by Ij?? and for fc G [m^-], b £ B. 
For j ^ S 1 , let rj = s 3 -. 

Let Is = UjeS ceb Ijc- Define q : Is — ► [n] x B by ?(i) = (j, c) if i G Ij c . The idea is that ? 
maps i to the input span program that must evaluate to true in order for \vi) to be available for P. 

Definition 2.4 ([Rei09a, Def. 4.5]). The direct-sum-composed span program Q® is defined by: 

• The inner product space is V® = ^©©j g s c eB(^ Ijc <S>V JC ). Any vector in V® can be uniquely 
expressed as \u) v + X^ie/ S 10 ® \ui), where \u) £ V and \ui) £ . 

• The target vector is \t®) = \t) v . 
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The free input vectors are indexed by J® ee — If ree U J5UU - 6g eB 

fe x O with, fori el® ee , 

if i G /free 

K®> = { |«i>v + |»> ® \t jc ) if i G and j £ S (2.8) 

^'c X /free 



|t') ® |^») i/i = («',*") G Jj C X /j? C 



TTie other input vectors are indexed by I^ k \ b for j G [n], G b £ B. For j ^ 5", 



i G Ijc and i' G P^ h , let 



|w«/> = l*> ® l«i'> • ( 2 -9) 



By [Rei09a, Theorem 4.3], fn® = g and wsize s (Q®) < wsize r (P). Moreover, we can bound how 
quickly the full witness size can grow relative to the witness size: 

Lemma 2.5 ([Rei09b, Lemma 2.5]). Under the above conditions, for each input x G B mi x • • • x 
B mn , with y = y(x), 

• If g{x) = 1, let \w) be a witness to fp{y) = 1 with Y^je[n] iei jy . r j\ w i\ 2 = wsize r (P, y). Then 



fwsize s (Q®,x) ( \ \\ \ 1 + £*e/ frcc H 



2 



< o-(y, \w)) + 



wsize r (P, y) wsize r (P, y) 

, . .. fwsize s .(P^) ( 2 - 10 ) 

where a(y, \w}) = max ^ — ; — - . 

jes-. wsize Sj (P iy i ) 

3i £ Zj y . tmtfi (il^) ^ 

If 9{ x ) = 0; ^ k') ^ e a witness to fp(y) = suc/i i/iai Sye[n] ie/,-g. r -?l WK)! = w size r (P, y). 



Then 



fwsize s (Q®,x) Ilk')!! 2 
< cr(y ; \w )) + 



wsize r (P, y) ' wsize r (P, y) 

, , m fwsize Sj (PW) ( 2 - n ) 

where a(y, \w ) = max — - : . 

V 1 " jeS: wsize s .(PW) 

3i £ Ijig. with (vi\w'} ^ 

If S = 0, i/ien <r(y, |io)) and <r(y, should each be taken to be 1 in the above equations. 

Lemma 2.6 ([Rei09b, Lemma 3.4]). If P^ is the direct-sum composition along a formula ip of span 
programs P v and Pi, then 

||abs(A Gp )|| <2maxmax{||abs(A Gp J||,||abs(A G t )||} . (2.12) 
If the span programs P v are monotone, then || abs(A Gp )|| < 2max t) || abs(Acp v ) || . 
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3 Evaluation of arbitrary AND-OR formulas 



Let <p be an AND-OR formula. In this section, we will prove Theorem 1.1 by applying Theorem 2.3 
to a certain composed span program P„. The construction of P^ has three steps that we will explain 
in detail below. 

1. Eliminate any AND or OR gates with fan-in one, and expand out AND and OR gates with 
higher fan-ins into gates of fan- in exactly two. 

2. Mark a certain subset of the edges of the formula. We call marked edges "checkpoints." 

3. Starting with the span programs for AND2 and OR2, compose them for the subformulas 
cut off by checkpointed edges using a version of tensor-product composition. Compose the 
resulting span programs across checkpoints using direct-sum composition to yield P«. 

Direct-sum span program composition keeps the norm of the corresponding graph's adjacency 
matrix under control, as well as the maximum degree of a vertex in the graph. However, it makes 
the full witness size grow much larger than the witness size, especially for highly unbalanced 
formulas. Reduced tensor-product composition generates strict span programs, for which the full 
witness size stays close to the witness size. However, it allows the norm and the maximum degree 
of the corresponding graph to grow exponentially quickly. By using both techniques in careful 
combination, we are able to manage this tradeoff so that Theorem 2.3 can be applied. 

Section 3.1 presents the span programs we use for fan-in-two AND and OR gates. 

In Section 3.2, we study reduced tensor-product composition for the span programs for AND 
and OR gates. Reduced tensor-product composition is a version of tensor-product composition that 
parsimoniously uses fewer dimensions when possible. For AND-OR formulas, it has the advantage 
that the output span program's inner product space bears a close connection to false inputs of the 
formula tp, similarly to canonical span programs. In order to motivate the checkpointing idea, we 
explain the problems of a scheme based only on reduced tensor-product composition. 

Section 3.3 then presents our full construction of P&, based on a combination of direct-sum and 
reduced tensor-product composition. 

Section 3.4 contains the analysis of the graphs Gp v {x) required to apply Theorem 2.3. 

3.1 Span programs for AND 2 and OR2 

We will use the following strict, monotone span programs for fan-in-two AND and OR gates: 

Definition 3.1 ([Rei09b, Def. 4.1]). Fors\,S2 > 0, define span programs -Pand(si> ^2) and Por(si, S2) 
computing AND2 and OR2, B 2 — > B, respectively, by 

w..*): »-(*)■ ^ 

Por(si,s 2 ): \t) = 5, \vi) = ei, \v 2 ) = e 2 (3.2) 

Both span programs have I\ \ = {1}, / 2 ,i = {2} and /f ree = I\ q = ^2,0 = 0- Here the parameters 
ctj , (3j , 5, €j , for j £ [2] , are given by 

aj = ( Sj /s p ) 1/4 Pi = 1 (3.3) 

5 = 1 €j = (sj/sp) 1 ^ , (3.4) 
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where s p = s\ + S2- Let a = y/a\-\- a| an d e = V e i + e 2- 

Note that a, e G (1, 2 1 / 4 ], They are largest when s\ = S2- 
Claim 3.2 ([Rei09b, Claim 4.2]). The span programs Pand(si, S2) and Pqr(si, 3%) satisfy: 



wsize (v ^ Tiv ^)(P R, x) 



v 

2 



ifxe {11,10,01} 

if x = 00 

(3.5) 

ifx € {00,10,01} 
if x = 11 



3.2 Reduced tensor-product span program composition for AND-OR formulas 

Reduced tensor-product composition of span programs is introduced in [Rei09a, Def. 4.6]. We 
repeat the definition here, specializing to the case of monotone, strict span programs acting on 
disjoint inputs. Also, for simplicity we consider the case of composing on one span program at 
a time. After stating the definition, we specialize further to AND-OR formulas, and characterize 
the reduced tensor-product span program composition of the AND and OR span programs from 
Definition 3.1. 

Consider monotone functions / : B x B n — > B and /' : B m — ► B. Let g : B m x B n —> B be 
defined by 

9(x,y)=f{f'(x),y) (3.6) 

for x £ B m , y G B n . Let P be a span program computing fp = f and let P' be a span program 
computing fpi = f . Assume that P and P' are both monotone, strict span programs. 

Let span program P be in inner product space V = C^, with target vector \t) and input vectors 
(l^i)} indexed by Ij\ for j G [n]. Let P' be in the inner product space V with target vector \t') and 
input vectors indexed by I' kl for k G [m]. Since P and P' are both monotone, Ijo = I' k0 = 0. 

Definition 3.3 ([Rei09a]). The tensor-product- composed span program, reduced with respect to the 
basis {\l) : I G [d]} for V, is Q T ® , defined by: 



Let Z = {I G [d] : Vi G In, (l\vi) = 0}. For I G [d], define Vi and |tt/) G Vi by 
Vi 



V' if I £ Z, i.e., (l\vi) 7^ for some i G hi 
C ifleZ 



(3.7) 

t) if Hz 
\\t')\\ ifleZ 



The inner product space of Q r ® is V r ® = ©i e [^] VJ. Any vector \v) G V r ® can be uniquely 
expressed as ^ze[d] \ v i)vi' where \vi) G V[. 

The target vector is 

|f®> = £<i|*>to>v! • ( 3 - 8 ) 

Q r ® is strict and monotone, thus iT® e = il® = /or a// A; G [m + n] . 
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The input vectors are indexed by 



and given by 



r® = [ hl x T ' kl ifk - m (3.9) 

kl if k > m, where j = k — m + 1 



, r®x = I Eigh M^KV, 4 = (MO G U< m ^f (310) 



*/ t € Ufc>m -'fcl 



The intuition behind this construction is to compose the span programs in a tensor-product 
manner somewhat similar to Definition 2.4. From [Rei09a, Def. 4.4], this would give a span program 
with target vector \t) ® \t') E V <8> V and input vectors either \vi) ® \v' it ) for i £ In or \vi) ® \t') 
otherwise. However, if all the In input vectors are zero in a coordinate / S [d], then the first type 
of input vectors are all zero on \l) ® V 1 . The second type of input vectors are all proportional to 
the same state \l) ® \t') on that coordinate, so we might as well just keep \l) \\ \t')\\ as in the above 
definition. The advantage over tensor-product composition is that the graph Gqt® associated to 
the span program Q r ® potentially has fewer vertices, with lower degrees. 

Here we have composed the span program P\ into the first input of P. Reduced tensor-product 
composition into the other inputs is defined symmetrically. 

By [Rei09a, Prop. 4.7], for arbitrary costs r G [0, oo) m and s £ [0,oo) n , 

wsize (rjS) (Q r0 ) < wsize {wsizer( p/ ))S) (P) . (3.11) 

Now let us study reduced tensor-product composition for AND-OR formulas. To start with, 
it will be helpful to give two examples of Definition 3.3, for the cases P' = Pob. and P' = Pand- 
Recall from [Rei09a, Def. 8.1] that the biadjacency matrix for the bipartite graph Gp(l 1+n ) is 
given by BQ p ni+ n \ = (\t) A), where A is the matrix whose columns are the input vectors of P, 
as defined in Section 2.1. Assume that In = {1} is a singleton set, with \vi) the first column of 
A. Rearrange the rows so that the nonzero entries of \vi) come first (the set Z from Definition 3.3 
comes last), writing \v\) = (|-y), 0), where I7) is nonzero in every entry. Writing \t) = (\ti) , fa)) , 
B Gp f 1 i+ n \ decomposes as 

d _(\h) It) CA m91 

B Gp{ll+n) -^ t2) Q . (3.12) 

• First consider the case that P' = Pand(si, S2) from Definition 3.1. Let Q r ® be the composed 
span program from Definition 3.3. Then 

fa x \t x ) /3i| 7 ) axCA 
B G (12+.) = a 2 \ti) a 2 Ci . (3.13) 

\a|t 2 ) aC 2 ) 

For comparison, the tensor-product-composed span program from [Rei09a, Def. 4.4] would 
have the biadjacency matrix 



fa\\tl) 


Pi\l) 





aid\ 


a 2 |*i) 





tort) 




aifa) 








OL\C2 


\a2\t2) 








OL2C2) 



(3.14) 
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• Next consider the case that P' = Por( s i, $2) from Definition 3.1. Let Q r ® be the composed 
span program from Definition 3.3. Then 

_(S\t 1 ) £l | 7 ) e 2 | 7 ) 5CA ( 
B °Q^ 2+n ) ~ [ S \ h ) SC 2 ) ■ (3 - 15) 

From Eqs. (3.13) and (3.15), we can derive a bound on the growth of the norm of the entry- 
wise absolute value of the biadjacency matrix for a span program, under reduced tensor-product 
composition with either Pand or Por: 

Lemma 3.4. Let P be a strict, monotone span program on 1 + n input bits, with = 1. For 

s%,S2 > 0, let P' be either Pand(si, s 2 ) or Por(si, s 2 ), from Definition 3.1. Let Q r ® be the reduced 
tensor-product composition of P' into the first input of P, as in Definition 3.3. Then 



|| abs(P G (l2+n) )|| 2 < Vpjypll abs(P Gp(11+Il) )|| 2 . (3.16) 

V s l ~r s 2 

Proof. Indeed, first consider the case that P' = Por(si,S2)- By rearranging and regrouping the 
columns of the biadjacency matrices, from Eq. (3.12), abs(P Gp ( 1 i+n)) can be rewritten as 

(A B) (3.17) 

for some entry-wise nonnegative matrices A and B, such that from Eq. (3.15), abs(P^^ ri8 (- 1 2+n)) 
can be rewritten as 

(5 A eiP e 2 B) . (3.18) 

Now if 5 were \J e\ + e|, then the norm of this latter matrix would be exactly ye| + e 2 , times the 
norm of the former matrix. Since in fact 5 = 1 < \TSy + if, we have the desired inequality (3.16). 

Next consider the case that P' = Por(si, S2). Rearrange the columns in Eqs. (3.12) and (3.13) 
to rewrite abs(P Gp ( 1 i+n)) and abs(P GQr0 ( 1 2+n- ) ) as, respectively, 



A B 
C 



(a x A {3 X B \ 
) and a 2 A (3 2 B , (3.19) 

\aC / 



for some entry-wise nonnegative matrices A, B, C. Now if (3\ and (5 2 were equal to a, then the norm 
of the right biadjacency matrix would be exactly a times the norm of the left matrix. Since in fact 
ft = = 1 < a , Eq. (3.16) holds. □ 

Let (p be an AND-OR formula of size n, in which each AND and each OR gate has fan-in two. 
Let r be the root of (p. For each vertex v in cp, let P v be the span program 

p _ \ p AT<ib(si(v), s 2 (v)) if g v is an AND gate ^ 
\PoR(si(w),s 2 (t>)) if flf„ is an OR gate 

Denote by a(v), ctj(v), /3j(v) and e(v),5(v),ej(v), for j £ [2], the parameters of P v from Defini- 
tion 3.1. 

Let P^ be the span program formed by composing the span programs P v according to the 
structure of (p from the root r of <p toward the leaves, in an otherwise arbitrary order, using 
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(c) (a?i A x 2 ) V x 3 (d) (asi V aj a ) A x 3 (e) ((xi A x 2 ) V a: 3 ) A x 4 



Figure 3: Examples to illustrate reduced tensor-product composition for AND2-OR2 formulas. For 
each formula (p, of size n, the graph Gp ¥ ,(l n ) is displayed. Vertices corresponding to maximal false 
inputs are so labeled. In (e), the primed variables refer to the span program coefficients for x±Ax 2 - 
Notice in each example that a vertex labeled with input x G {0,1}™ is connected exactly to those 
input bits j with xj = 0; this is a consequence of Eq. (3.22). Also notice that the graph's structure 
changes locally as each additional gate is composed onto the end of the formula, e.g., from (d) 
to (e). However, edge weights change nonlocally. See also Figure 2. 



reduced tensor-product composition with respect to the bases of Definition 3.1. Note that P v is 
strict and monotone. If for each v, s\(v) and s 2 (v) are set to be the sizes of the respective input 
subformulas, then wsize(P v ,) = \fn. Figure 3 has several examples. 

We can characterize P v in terms of the set of "maximal false" inputs, or minimal zero-certificates, 
to the formula (p. 

Definition 3.5. An input x 6 B n is a maximal false input to (p if (p{x) = and flipping any bit of 
x from to 1 changes the formula evaluation to 1. 

To any maximal false input x corresponds a subtree T x of (p. T x is rooted at r, and its leaves 
are exactly the leaves of <p corresponding to input bits k with Xk = 0. Note that for each vertex 
v £ T x , if g v is an OR gate, then both of v 's children are also in T x ; and if g v is an AND gate, then 
exactly one of v's children is in T x . 

Lemma 3.6. Let U be the set of maximal false inputs to (p. Then P v is given as follows: 

• Its inner product space is V = C u . 

• Its target vector is 

n{ Oij{x,v){v) ifg v = AND 2 \ TT / "0) if g v = AND 2 \ \ , , 
r I S(v) ifg v = OR 2 / " 11 1 S(v) ifg v = OR 2 J 1 ' ' 

(3.21) 
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Both products are over internal vertices only (the parameters a(v),... are not defined for 
leaves). In the first term j(x,v) £ [2] indicates the child of v that is in T x . 

• Its input vectors are indexed by I^i = {k}, I^q = for k £ [n]. Letting 7^ be the simple path 
from the k'th leaf to r, \vk) is given by 

w - e (n { >™$ } • n { ^ w } n { t] }) w • 

Here in each bracketed expression the top term is to be taken if g v is an AND gate, and the 
bottom term if g v is an OR gate. The indices j{x,v) £ [2] are as in the expression for \t), 
while j(k,v) £ [2] indicates the child of v that is along the path 7^. Products are over internal 
vertices only. 

In particular, forx £ U, (x\vk) = if and only if x^ = 1. Thus \x)/(t\x) is a witness for j 'p v (x) = 0. 

Proof. Although the expressions are intimidating, the proof is a simple induction. Assume that 
we have completed reduced tensor-product composition of the span programs P v for vertices v 
belonging to a subtree ip' that includes r. Then ip' is also an AND-OR formula. Assume that the 
characterization of Lemma 3.6 holds for ip'. 

Consider adding a new vertex v onto ip 1 , yielding a formula ip". We will use primed variables, 
U', T' x , 7^,, to refer to ip' and double-primed variables for ip" . 

The base case of the induction is if ip' is empty and ip" = {r}. Then the claim is a consequence 
of Definition 3.1. If g r is an AND gate, then U" = {01, 10}, while U" = {00} if g r is an OR gate. 

Now assume that the size of <p' is at least two. By symmetry, assume that the first input of 
cp' is replaced by v. Then by induction, note that Z = {maximal false inputs x to ip' \ x\ = 1} in 
Definition 3.3. There are two cases, depending on whether the gate g v is an OR or an AND. 

• If the new gate is an OR, then the maximal false inputs of ip' are in one-to-one correspondence 
to those of the new formula ip". By Definition 3.3 the inner product space does not change. 
Moreover, the target vector is scaled simply by 5(v). All but the first input vector of P^i are 
scaled by 5(v). The first input vector is split into two vectors, scaled by e\(v) and 62(1^). By 
examination of Eqs. (3.21) and (3.22), the induction assumption is maintained. 

• If the new gate is an AND, then a maximal false input lx of ip' corresponds to the maximal 
false input 11 a; of ip", while any maximal false input Ox of ip' splits into the two maximal 
false inputs Olx and lOx of ip" . Consider first a maximal false input lx. Since lrc £ Z, the 
target and all input vectors are simply scaled by a{v) in this coordinate. This satisfies the 
induction hypothesis since v £" T" lx . 

Next consider a maximal false input Ox to ip'; v £ Tq 1x C\T"q x . By Eq. (3.8), the Ox coordinate 
of the target vector splits in two, weighted by oi\{v) and ct2(v), so Eq. (3.21) continues to hold. 

Similarly, for the unchanged inputs k, i.e., inputs with v ^ 7^, Qioa-j-i/'j) = (a^Cu)) ^ aJ l v *) 
by Eq. (3.10). This is accounted for by the second term of Eq. (3.22). By Eq. (3.10), 

(K<>) = ( /3l o v) )( 0x \ v 'i)- This shows U P in the first term of E Q- ( 3 - 22 )> since v G 7i- A 
similar argument holds for the input vector |v 2 '). □ 
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One straightforward consequence of Lemma 3.6 is that the order in which gates are composed in 
Ptp does not matter. In fact, the composition order does not matter for direct-sum, tensor-product 
or reduced tensor-product composition of arbitrary span programs. Rather than prove this claim, 
though, in the sequel we will continue to order composition from the root toward the leaves. 

Since its construction uses reduced tensor-product composition, Pu, has similar properties as a 
canonical span program [Rei09a, Def. 5.1]. A canonical span program has a dimension for every 
false input, whereas P^ has a dimension only for each maximal false input. Unlike a canonical span 
program, P«'s target vector does not in general have uniform weights. However, if x 6 B n has 
<p(x) = 0, let x 1 be a maximal false input that lies above x, i.e., the bitwise AND of x and x 1 is x. 
Then \x') / (t\x') is a witness for fp v {x) = 0. This property is a main motivation for defining reduced 
tensor-product span program composition; it does not hold for tensor-product composition. 

Unfortunately, a construction based only on reduced tensor-product span program composition 
will not work for applying Theorem 2.3. There are two problems: 

1. First, the number of maximal false inputs can be exponentially large in the size n of the 
formula. For example, if (p is a balanced formula of depth d with alternating levels of AND2 
and OR2 gates, starting with AND, then there are ^4 2L(d 1)/2J = fPW") maximal false inputs. 
Since there are only n input vectors, this implies that the maximum degree of a vertex in the 
graph must be exponentially large. 

2. Second, the norm || abs(^4c p ^)|| can also be exponentially large. Indeed, a(v) can be as 

large as 2 1//4 when the two input subformulas to v have the same size. Then, for example, a 
balanced formula of depth d with only AND2 gates leads to a target vector with coefficients 



The advantage of reduced tensor-product composition, though, is that because it outputs a strict 
span program P^, the full witness size can be easily bounded in terms of the witness size. 

The disadvantages of reduced tensor-product composition are worst for very balanced formulas, 
while its advantage is most helpful for unbalanced formulas. This suggests that a combining the 
two techniques might be useful for general general AND-OR formulas. 

Before turning to such an approach, though, let us first restate Lemma 3.6 for the case of a max- 
imally unbalanced formula. Lemma 3.7 is a key structural claim behind our proof of Theorem 1.1. 
Once again, Figure 3 has several examples. 

Lemma 3.7. Let if) be a maximally unbalanced AND-OR formula, i.e., the depth of the formula 
equals the number of gates J. Index the inputs in order from farthest to closest to the root (see 
Figure 4)- Let Tand = {j € [ J + 1] : J is an input to an AND gate}, and Tor. = [ J + 1] \ Tand- 

Then the maximal false inputs U to tp are in one-to-one correspondence to the elements of 
Tp = Tand U {!}• To j € Tp corresponds the maximal false input x J G B J+l given by 



each2i( 2d -( 2d+1 )). 




(3.23) 



The reduced-tensor-product-composed span program P^ is given as follows: 



• Its inner product space is V 
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• Its target vector is 




(3.24) 



Here, in the first term t(j,v) £ [2] indicates the child of v that is in 7,-, the simple path from 
the jth vertex to the root. In each bracketed expression the top term is to be taken if g v is an 
AND gate, and the bottom term if g v is an OR gate. The products are over internal vertices v. 

• Its input vectors are indexed by I^i = {k}, I^o = for k £ [J+l]. For k £ Tand U [min Tand] > 
\v}~) is given by 

w -n{SSSS}-n{^}« 

where k = k if k £ Tand an d k = 1 otherwise. For k ^ Tand U [min Tand] > 

w-sfn n { "xf } ■ n { tl }) W} ■ (3 - 26) 

j<k 

The same conventions are understood as in the expression for \t). 
In particular, for x £ U, \x)/(t\x) is a witness for fp^(x) = 0. 

Proof. The lemma follows from Lemma 3.6. The main simplification to make is that the tree 
T x j = 7j L){k £ Tor : k > j}, so T x j and jj agree on internal vertices. Then Eq. (3.22) simplifies to 

w - e (n { } ■ n { } • n { }) w ■ ^ 

This further simplifies to Eq. (3.25) when A; € Tand U [min Tand] because then the sum over j 6 Tp 
with xi = has only a single term, either k itself or 1 if k < min Tand- It simplifies to Eq. (3.26) 
when k ^ Tand U [min Tand] because then x J k = for j 6 Tp exactly when j < k. □ 

3.3 AND-OR span program construction using hybrid composition 

Let (p be an AND-OR formula in which every gate has fan-in two, possibly after expanding higher 
fan- in gates. We now construct the span program P v on which the algorithm in Theorem 1.1 
is based. For each internal vertex v of <p, fix the parameters si(v) and 52(f) to the sizes of the 
respective input subformulas. Assume without loss of generality that s\(v) > 52(f) always. 

To begin the construction, we mark certain edges of the formula. Marked edges are termed 
"checkpoints," because they will serve to cut off reduced tensor-product span program compositions 
and the associated exponential growths in norm and degree. There are two steps to placing the 
checkpoints: 
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1. For every internal vertex v, i.e., a vertex that is not a leaf, mark the edge to the smaller of 
its two input subformulas. Break ties arbitrarily. 

After this step, every gate has exactly one unmarked input edge, so the marked edges divide 
ip into a set of paths. Let 

S = {vertices v : for one of the paths, v is the endpoint closer to the root r} . (3.28) 

Certainly the root r is itself in S. 

2. In the second step, place more checkpoints to split up paths that are too long. For each path, 
apply the following rule: 

Starting at the far end of the path and moving toward the root, keep track of the product 
yr f a(v) if g v = AND 2 1 TT f T^M+V^M 

for internal vertices v along the path. Note that a(v),e(v) < 2 1 / 4 ~ 1.19. After adding a 
vertex that makes the product exceed \fe ~ 1.65, split the path by adding a checkpoint. 

After finishing this step, there will be no paths with the above product more than 2 1 / 4 - v /e, and 
for all paths except possibly those ending at a vertex in S, the product will be at least ^/e. 

We remark that our analysis in Section 3.4 is not overly sensitive to modifying these rules, for 
example by using a different constant greater than one instead of \fe in the second step. 

Based on the checkpointed formula, we can now construct the composed span program P v : 

1. First, for each path £, compose the span programs P v from Eq. (3.20) along the path, using 
reduced tensor-product composition, to obtain a span program P%. 

2. Next, apply direct-sum composition to compose the P^ span programs constructed in the first 
step across the checkpointed edges. 

Let Ptp be the resulting span program. Figure 2 shows an example. Notice that when re- 
duced tensor-product and direct-sum span program composition are both used, their relative order 
matters. In constructing P„, all direct-sum composition comes last. 

3.4 Analysis of 

Proof of Theorem 1.1. From Claim 3.2 and the span program composition results [Rei09a, Theo- 
rem 4.3, Prop. 4.7], we obtain: 

Lemma 3.8. P^ computes fp v = (p and wsize(P ((3 ) = ^Jn. 

In order to apply Theorem 2.3, the basic idea is to treat the gates along each checkpointed path 
£ as a single grouped gate, and to analyze the direct-sum composition of these grouped gates as in 
the proof of [Rei09b, Theorem 1.11]. There are two steps to this analysis. 

1. First, we argue that || &bs(AG P )|| = 0(1) and Gp v has maximum degree 0{^fn). 
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2. Second, to bound the full witness size we apply Lemma 2.5 to the direct-sum composition of 
the grouped gates, similarly to [Rei09b, Lemmas 3.3, 4.4]. 



Let us establish a bound on ||-Ag p II- Since P v has nonnegative entries, dhs{Ac PLf: ) = Aq 

Lemma 3.9. The norm of the adjacency matrix Aq p ^ is at most 2{2y/2e + 1) = 0(1). 

Proof. By Lemma 2.6, it suffices to bound the norm of Ag p ^ for any checkpointed path £. 
By definition, if a path £ involves J internal vertices, 

B^ 

A Gpc =10 C I (3.30) 



ct 



where B is the biadjacency matrix B Gp nj+i) and C is a column of zeros followed by an identity 
matrix. Therefore we bound 



A Gp J\ < 



B 
£t 



+ 



C 
Ct 



B\\ 2 + l . (3.31) 



Now from Lemma 3.4 and the checkpoint rule Eq. (3.29), \\B\\ 2 < y/2e\\(l 1)|| 2 = 2y/2e. □ 

For a path £, let be the AND-OR formula that is the composition of the gates along the 
path £. ip(£,) is maximally unbalanced, so Lemma 3.7 applies to P^ = Pm£\- In particular, this 
allows us to bound the maximum degree of a vertex in Gp e , and to bound the lengths of witnesses 
to f P ^ () (x) = 0: 

Corollary 3.10. The maximum degree of a vertex in Gp v is 0(y/n). 

Proof. Since P^ is constructed by direct-sum composition of span programs Pg, the maximum 
degree of a vertex in Gp v is at most twice the maximum degree of a vertex in a graph Gp 5 , which 
is at most twice the number of vertices in Gp^ . 

Fix a path £ with J gates. By Lemma 3.7, the number of vertices in Gp^(l J+1 ) is 1 + \Tp\ + 
{J + 1) < 2 J + 3. Now n^e£ a(v) — 2 1//4 \/^i but each a(v) satisfies 

a(v) 2 > -=^= > 1 + — = , (3.32) 



where in the first inequality we used S2(v) > 1 and s±(v) < n. Hence J = 0(y/n). □ 

Corollary 3.11. For a checkpointed path let ip = and recall from Lemma 3.7 the definitions 

of Tp = Tand U {1} and of the maximal false inputs x 3 for j £ Tp. Let m be the size of the 
subformula of if rooted at the root o/£. 

Then for any j £ Tp, \w'j) = \x 3 )/{t\x 3 ) is a witness for fp^x 3 ) = 0, with 



'V2e if j = l 
\f2eJm otherwise 
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J + l •■■ 3 2 



Figure 4: A typical checkpointed path £ in </? on J = 6 vertices. The root r is to the left. Input 
subformulas are indexed from right to left; of 1 and 2, the larger subformula comes first. 



Proof. The coefficient (t\x J ) has been computed in Eq. (3.24). Since a(v) > 1 and 8(v) = 1 always, 
we need to place an upper bound on l/|(t|a^")| < n«e7j a i,(j,v)( v ) ■ 



Note that 



1 S 1 (V) + S 2 (V) r— -j-r 

ai{v) z y si(v) 



(3.34) 



where r(v) = S2(v)/s\(v) < 1. Since a(v) 2 = (l + y/r(v)) /y/l + r(v), therefore ai ^ 2 < a(w) 2 . On 
the other hand, the best bound we can place on a2 ^ v y2 is, since S2(v) > 1, 



8l(v) + S 2 (v) / 



a2(v) 2 

When j = 1, t(j, v) = 1 for every u, so we obtain the claimed bound 



(3.35) 



;-)f <Y[a(v) 2 < V2e . (3.36) 



For j > 1, all but one of the indices i(j, w) will be 1, and for the last internal vertex v on jj, v) 
will be 2. It follows that |||^)f < (f\ v ^ a(v) 2 )^m < V2e^/m. □ 

Let ip' be a formula whose internal vertices are the checkpointed paths in <p and whose leaves 
correspond to the inputs of (p. The formula ip' is not an AND-OR formula; its gate at an internal 
vertex v' is the composition of the gates in the corresponding path in tp, g' v , = fp^, v ,y However, 
<p' and (p compute the same boolean function. Let r' be the root of <p', corresponding to the path in 
<p that includes r. For each vertex v' of tp', let ip' , be the subformula rooted at v' , and let P<y be 
the span program obtained by direct-sum composition of the span programs P^m) f° r an vertices 
w' in ip' v ,. Then = P^ r Let s„' be the number of inputs to ip' v ,, so wsize(P^' ; ) = ^Js^i. 

Call an internal vertex v' of ip' small if the corresponding path £(?/) has an endpoint in the set 
5 from Eq. (3.28). Aside from the root r', every small vertex v' has subformula size s v / no larger 
than the size of its sibling subformula in ip\ hence the name. 

Lemma 3.12. Let v' be an internal vertex of ip' , with children c' l7 c' 2 , ■ ■ ■ , c' J+1 , sorted in decreasing 
order of their distances from r' , and with s c / > s c ^ (see Figure 4)- Then for j > 2, s c / < s v i/2. If 

v' is not a small vertex, then s c ^ < s v > — ^yfihj'- 

Proof. In placing checkpoints, at every vertex v the edge to the smaller input subformula is marked. 
Thus the size of that subformula can be at most half the size of <p v . However the larger subformula 
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can have size up to s v — 1. Assuming that v' is not small, we will argue that in the second step of 
placing checkpoints, paths are allowed to grow long enough toward the root that the size increases 
significantly. 

Say that in the second step of placing checkpoints we begin with a single vertex whose input 
subformulas have size s and ris, where r\ £ [1/s, 1]. The next vertex toward the root will have 
another input subformula whose size is, say, r2(s + ris), where r 2 £ [l/(s + r%s), 1]. Similarly the 
jth vertex towards the root r will have a smaller input subformula of size Ofc<j + r k), so its 
two subformulas have total size sf3 A , <:) (l + r^). Here, rj < 1 and 1/rj < s Y\ k< j(l + r^). 

Now it is possible that this path gets all the way to S without a new checkpoint being placed. 
Then this path corresponds to a small vertex, and we can make no strong claim about how much 
the size increases along the path. For example, if the path starts at the root r, then no further 
checkpoints can be placed, so we can only bound s c i < n — 1. 

Assume that a checkpoint is placed to terminate this path. Then we have Y[j J — e - We 
want to lower bound rX/(l+ r :/)- Letting Xj = log 1 tp^ G (0, | log 2], log(l+rj) = log — = . 

Applying Jensen's inequality gives - (1 + rj) > e 1 ^ > 1 + 1/J, where J is the number of vertices 
along the path. 

We have s v > = s^ Ylji^ + r j) — 2- If J > -j= , then since at each step toward the root the 
size must increase by at least one, s^ < s v > — J < s v > — ^y/sv', as claimed. If J < ^y/sv>, then 
using s c / < s v i/(l + 1/J) again gives s c ^ < s v ' — -^myfsv'- D 

In the maximally unbalanced formula, s c ^ = s v > — 0{^/s~^i), so aside from improving the constant 
the bound on s c ^ in Lemma 3.12 is tight. 

Lemma 3.13. Let v' be an internal vertex of if/, and let m = s v >. Then 



where A = ^2e » 3.84 and k = (1 + ^)A/log2 « 9.47. 

Proof. The proof is by induction in the maximum distance from v' to a leaf in ip' . The base case 
is if all of v"s inputs are leaves. This case can be handled simultaneously to the induction step by 
letting S = 0, so a = 1, in the applications of Lemma 2.5 below. 

Take v' an internal vertex, with children c[, c' 2 , ■ ■ ■ , c'j +1 , sorted in decreasing order of their 
distances from r' , and with s r > > s r i . Note that each vertex c' - with j > 2 must be either small or 
a leaf. However, is not a small vertex. Let £ = £(V) be the corresponding checkpointed path 
in Consider an input x G B m . We will use Lemma 2.5 in combination with Lemma 3.12 and 
Corollary 3.11. 

If <p' v f(x) = 1, then apply Lemma 2.5 with S = {j £ [J + 1] : c'- is not a leaf}. Since P^ v >) is a 
strict span program, Eq. (2.10) gives 




(3.37) 



fwsize(R,/ , a?) 

r „,/ 



1 



(3.38) 
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where a = maxjgs fwsize(P ¥ ,' )/ /s^7. Now by Lemma 3.12, for j £ S with j > 2, s c / < m/2 and 
by induction 

fwsize(P^/ ; )/^/v" < relog s c '. + X/^/s^ . (3.39) 



Since k > A/(2v2), the right-hand side is an increasing function of s c /, so may be bounded by 
Atlog(m/2) + A/a/ to/2. For the case j = 1, by induction fwsize(P ¥ ,' / )/y/s^ < «logs c > . 



If u' is not small, then Lemma 3.12 gives s c ^ < m — y^m/2, and therefore 



er < max | /clog (m — \An/2), Klog(m/2) H 1 . (3.40) 



The first term, bounded by «;(logm — l/v / 2~m), is at most k log to — 1/ y/m, provided that k > \[2. 
The second term satisfies the same bound provided k > (A + ^)/log2. 

On the other hand, if v' is small, then we can only be sure that s c / < s v i — 1 = m — 1. This is 
all right, because Eq. (3.37) allows for more slack in this case. In particular, it is enough to show 
that Klog(m/2) + A/ \/m/2 < Klogm, which indeed holds for k > A/ log 2. 

Assume now that <p' v /(x) = 0. Let x' be the input to g' v ,, i.e., the evaluations of v"s input 
subformulas on x. Let y' be any minimal false input (Definition 3.5) to g' , that lies above x' 
(meaning that for every k, y' k > x' k ). In the notation of Lemma 3.7, y' = x 3 for some j G Tp, and 
= is a witness for fp ( , v ,Ax') = 0. By Eq. (2.11), then, 

fwsize(P^ ; ,x) IIIOII 2 
< a(x , \w j )) + 



to J 

fwsize(P^ ) (3.41) 
where a(x' , It/;,-)) = max — . 

fc£S: / fi , 

= and (v^w'j) ^ ^ c fe 

There are two cases to consider, j > 1 and j = 1. 

First, if j > 1, then by Lemma 3.7, (t!fc|u/-) = for all k < j. Therefore, a = a(x' , will 

only maximize over small vertices, c' k with > 1. By induction, a < «log(m/2) + X/y/m/2. On 
the other hand, Corollary 3.11 gives only |||w;^)[| 2 < A\/m. Putting these bounds together, 

fwsize(P,y , x) 

^ </clog(m/2) + AA/W2 + A 

yjm (3.42) 

< k log m, 

provided that k > 2A/log2. The above bound holds whether or not v' is small. 

Next consider the case j = 1. Then we will have a worse bound on a, but Corollary 3.11 gives 

induction hypothesis, we obtain 



/('',,; < A. If j = 1 and v' is not small, then Lemma 3.12 gives s c ' < to — y^m/2. Using the 



fwsize(P v ,/ / , x) , A -) A 

- < max \ «dog(m — Wm/2), nlog(m/2) H > H — . (3.43) 

L " a/to/2J a/to 



TO 



This is indeed at most k log to provided that k > (1 + ^)A/log2. 
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If j = 1 and v' is small, then we can only be sure that s c / < m — 1. However, just as before, this 
is enough, since then Klog s c ^ < k log m, while ftlog(m/2) + X/^/m/2 < ftlog m for k > A/ log 2. □ 

Substituting = r' into Lemma 3.13 gives fwsize(P„' ) = fwsize(P v ,) = 0{^Jn log n). Lemma 3.9 
bounds the norm of Aq p ^ and Corollary 3.10 bounds the maximum degree of a vertex. Therefore, 
Theorem 2.3 applies, completing the proof of Theorem 1.1. □ 

4 Open problems 

It is possible that our analysis here is loose. Lemma 2.5 is conservative, as it uses the worst input 
ratio fwsize(P- J )/wsize(P : '). Potentially a more careful analysis of the full witness size across span 
programs Pg could improve our upper bound. However, we do not believe that the full witness size 
of P<p is 0(y/n). More ideas seem to be needed to find an 0(y / n)-query quantum algorithm for 
evaluating arbitrary size-n AND-OR formulas, particularly if we wish the algorithm also to have 
poly-logarithmic time overhead after preprocessing. One very simple idea would be to start with 
different span programs for AND and OR. By [Rei09a, Lemma 4.12], there are many possibilities; 
the same invertible linear transformation can be applied to the target and all input vectors without 
changing the witness size. We have unsuccessfully investigated choices to see whether reduced 
tensor-product composition alone would be sufficient to build an optimal span program for which 
|| abs(AG p ^)|| = O(l), but have not studied other choices under hybrid span program composition. 

Some preprocessing will always be necessary if the formula cp is presented poorly to the algo- 
rithm. However, we would like the preprocessing to correspond to as natural a presentation of (p 
as possible, and there is clearly more work to be done. 

Theorem 1.1 and [Rei09b, Theorem 1.11] can likely both be generalized to apply to formulas 
over a larger class of gates. In particular, the idea of combining direct-sum and tensor-product span 
program composition might be useful in other contexts. It leads to a dramatic speedup on AND-OR 
formulas that have not been rebalanced. Since rebalancing and its effect on the adversary bounds is 
poorly understood for formulas over larger gate sets, this seems like promising technology to apply. 
We have specialized to AND-OR formulas because they form an important class of formulas, and 
because the span programs for the AND and OR gates are especially simple. Further applications 
will require studying other particular span programs more carefully. 

Although our algorithm can be analyzed without the span program formalism, it would not 
have been discovered without a certain familiarity with span programs. Will span programs be 
useful for finding quantum algorithms for problems beyond formula evaluation? One approach is 
to try to solve the semi-definite program (SDP) for the optimal span program witness size [Rei09a]. 
This SDP is exponentially large, so presumably is difficult to solve exactly, but for special cases 
perhaps it can be solved to within a constant factor of the optimum. Even if so, the span program 
this gives will typically correspond to a graph with large norm and high degree. To turn this into 
an algorithm that is time efficient, and not just query efficient, it will be useful to find techniques 
for breaking up large span programs, perhaps by using tailored semi-definite programs. It is known 
how to convert a span program into a strict span program without affecting the witness size [Rei09a, 
Prop. 4.10]. However we do not know of any techniques for converting a span program with low 
witness size into a span program with low full witness size that additionally has smaller norm and 
lower degree. 
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